Skip to content

fix(network_spec): add mandatory router field to admin_network for correct DHCP gateway#4821

Merged
snarthan merged 1 commit into
dell:stagingfrom
sujit-jadhav:fix/OMNDF-369-admin-network-router-field
Jul 9, 2026
Merged

fix(network_spec): add mandatory router field to admin_network for correct DHCP gateway#4821
snarthan merged 1 commit into
dell:stagingfrom
sujit-jadhav:fix/OMNDF-369-admin-network-router-field

Conversation

@sujit-jadhav

Copy link
Copy Markdown
Collaborator

Problem

In multi-subnet clusters, CoreDHCP advertised the OIM IP (primary_oim_admin_ip) as the DHCP gateway (option 3). Since the OIM is not a network router, nodes on additional subnets could not route traffic back to the admin subnet. This caused Slurm compute nodes on different subnets to get stuck in Completing state due to broken node-to-controller communication.

Example: nid009 (172.20.46.74) could not reach nid007/controller (172.20.44.89) because the gateway advertised was the OIM IP (172.20.44.51) instead of the actual router (172.20.44.1).

Root Cause

coredhcp_router was hardcoded to �dmin_nic_ip (the OIM's IP address). The OIM does not perform IP routing between subnets, so cross-subnet DHCP clients received a non-functional gateway.

Fix

Add a mandatory
outer field to �dmin_network in
etwork_spec.yml, allowing users to specify the actual network gateway. This value is propagated to coredhcp_router in CoreDHCP configuration.

Changes

File Change
input/network_spec.yml Add
outer field with default value and documentation
common/.../schema/network_spec.json Add
outer to required fields with IPv4 pattern validation
common/.../provision_validation.py Add mandatory IPv4 validation for
outer
common/.../en_us_validation_msg.py Add descriptive error message guiding users to use primary_oim_admin_ip if no dedicated router
prepare_oim/.../deploy_openchami.yml Set coredhcp_router from
etwork_data.admin_network.router
prepare_oim/.../refresh_openchami_configs.yml Set coredhcp_router from
etwork_data.admin_network.router (no fallback needed)
prepare_oim/.../templates/configs.yaml.j2 Persist coredhcp_router to configs_vars.yaml
upgrade/.../templates/network_spec.j2 Add
outer with fallback to primary_oim_admin_ip for 2.1→2.2 upgrades
upgrade/.../upgrade_openchami_containers.yml Handle coredhcp_router in configs regeneration and loading paths
upgrade/prepare_upgrade.yml Add �dmin_network.router to upgrade review banner

Workflows Verified

  • Fresh install (prepare_oim.yml): Validation enforces mandatory router → propagated to CoreDHCP
  • Re-run (
    efresh_openchami_configs.yml): Re-reads
    etwork_spec.yml → updates CoreDHCP
  • Upgrade from 2.1 (prepare_upgrade.yml → upgrade.yml):
    etwork_spec.j2 defaults router to primary_oim_admin_ip for backward compatibility

JIRA

OMNDF-369

Signed-off-by: Sujit Jadhav sujit.jadhav@dell.com

…rrect DHCP gateway (OMNDF-369)

Previously, CoreDHCP advertised the OIM IP (primary_oim_admin_ip) as the
DHCP gateway (option 3). In multi-subnet clusters, nodes on additional
subnets could not route traffic back to the admin subnet because the OIM
is not a network router. This caused Slurm compute nodes on different
subnets to get stuck in Completing state due to broken node-to-controller
communication.

Changes:
- Add mandatory 'router' field to admin_network in network_spec.yml
  with default value matching primary_oim_admin_ip (172.16.107.254)
- Propagate router value to coredhcp_router in deploy_openchami.yml,
  refresh_openchami_configs.yml, and configs.yaml.j2 template
- Add L1 validation: router added to required fields in network_spec.json
  schema with IPv4 pattern
- Add L2 validation: mandatory IPv4 check in provision_validation.py
  with descriptive error message in en_us_validation_msg.py
- Update upgrade template (network_spec.j2) to include router field with
  fallback to primary_oim_admin_ip for backward compatibility
- Update upgrade_openchami_containers.yml to handle coredhcp_router in
  both configs_vars.yaml regeneration and existing config loading paths
- Add router field to prepare_upgrade.yml review banner

Signed-off-by: Sujit Jadhav <sujit.jadhav@dell.com>
@sujit-jadhav sujit-jadhav changed the title fix(network_spec): add mandatory router field to admin_network for correct DHCP gateway (OMNDF-369) fix(network_spec): add mandatory router field to admin_network for correct DHCP gateway Jul 8, 2026
@snarthan snarthan merged commit ed53e87 into dell:staging Jul 9, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants